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Description 

Method of processing test patterns for an integrated circuit 

5 To achieve high perfomance and high integration density, the 
dimensions of integrated circuit components are scaled down 
more and more. In particular, transistor dimensions are 
scaled down while lower # power dissipation is achieved by- 
scaling down the supply voltage. However, due to high 

10 packing density of transistors, the power supply current is 
increasing, and hence, large current swings within a short 
period of time can cause considerable noise. As a 
consequence, one difficulty circuit designers face is the 
power delivery of very high performance circuits due to the 

15 severe switching noise. 

In order to verify the function of a newly designed 
integrated circuit, the circuit is first simulated and then 
tested. During simulation, multiple input signals are 
20 applied to the inputs of the circuit, and the output signals 
of the circuit calculated. The input signals are referred to 
as test patterns. If the output signals do not sufficiently 
approximate preset target signals, the circuit is redesigned 
and resimulated. 

25 

Subsequently, when simulation is completed, a chip containing 
the integrated circuit is manufactured and tested using ATE 
(Automatic Test Equipment) . The ATE also applies a test 
pattern to the circuit. The test pattern for the ATE has to 

30 be input manually by a user. Generally, the same test 

pattern that has been used for simulation is also used for 
testing. If the output signals generated by the circuit in 
response to the test pattern of the ATE deviate from preset 
target signals, the circuit is redesigned, resimulated and 

35 retested. 

As the complexity of integrated circuits increases, 



200207799 & 200207778 / IT465 



2 

integration density and functionality increases dramatically. 
The simultaneous switching of a large number of transistors 
induces a large current spike. The switching noise on the 
power distribution network must be suppressed to a tolerable 
5 level to ensure the reliability of the circuit. In order to 
efficiently combat the switching noise, estimation of the 
worst case switching noise is required. 

o * * 

On way of determining the worst case switching noise is to 
10 simulate all combinations of input patterns to determine 

which combination will induce the maximum switching noise. 
However, the complexity of the solution space is 
exponentially proportional to the number of primary inputs of 
the system. Accordingly, it would require an enormous time 
15 to process the entire solution space for even a moderately 
complex system. 

As a consequence, it is almost impossible to determine all 
test patterns that cause worst case switching noise by 
20 simalation or testing. Accordingly, a small set of test 

patterns that cause at least some worst case scenarios can be 
selected. However, this way, the simulation or testing of 
the integrated circuit may not be satisfactory. 

25 The designer thus has to accept either enormous time 

requirements for simulation and testing, or potentially 
insufficient simulation or testing efficiency. This is 
clearly undesirable. 

30 To this end, some approaches have been proposed to deal with 
these problems. In "Estimation of Switching Noise on Power 
Supply Lines in Deep Sub-micron CMOS circuits", Shiyou Zhao 
and Kaushik Roy, 13 th International Conference on VLSI 
Design, IEEE January 2000, there is proposed a probabalistic 

35 approach to determine the lower bound of the worst case 
switching noise on power supply lines. The algorithm 
described therein traces the worst case input patterns which 
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induces the steepest maximum switching current spike and 
therefore the maximum switching noise . This is based on the 
observation that the maximum switching noise is directly 
related to the steepest maximum switching current spike. 

5 

In this approach, the design of an integrated circuit is 
simulated by applying randomly generated input signal vectors 
to the inputs pf the circuit. .For each input vector pair, 
the simulated peak switching current is determined . The 

10 worst case input vector pairs feed, as initial population, a 
genetic algorithm. The genetic algorithm is designed to 
single out the near optimal input pattern (s) that induce the 
steepest maximum switching current spike and, therefore, the 
worst case switching noise. The worst case input patterns 

15 are then used in HSPICE simulation of the circuits to extract 
the exact current waveform. 

One problem associated with this approach is the difficulty 
of generating suitable random test patterns. The larger the 
20 number of random test patterns, the higher the likelihood of 
generating a test pattern which approximates the worst case 
sufficiently. However, since the simulation of each test 
pattern is time consuming, the simulation of a large number 
number of test patterns is not practical. 

25 

In particular, if a genetic algorithm is used, it is too time 
consuming to simulate every single random pattern out of 
every new pattern population before the algorithm is able to 
determine which of the patterns of the population is to be 

30 selected for further optimization. Therefore, this method 
becomes saturated by the number of trial random patterns in 
each pattern population. It is suitable for small circuits. 
However, it could take up to years to perform a full chip 
simulation of a large circuit using even the fastest 

35 simulation applications. 

The present invention aims to address these problems. 



200207799 & 200207778 / IT465 



4 

According to one aspect of the invention, there is provided a 
method of approximating the behaviour of an integrated 
circuit, the method comprising: 
5 (a) applying a set of test patterns to a system for testing 
or simulating an integrated circuit; 

(b) applying the set of test patterns to a neural network; 

(c) comparing the outputs of the system for testing or 
simulating the integrated circuit and the outputs of the 

10 neural network; and 

(d) adapting parameters of the neural network to approximate 
the behaviour of the integrated circuit on the basis of the 
comparison . 

15 In particular, the system for testing or simulating the 

integrated circuit may be an automatic test equipment (ATE) , 
and the set of test patterns is applied to the integrated 
circuit via the automatic test equipment . The neural network 
may be integrated in the ATE. It may be implemented using 

2 0 any known ATE. 

The invention is based on the idea that the dynamic behaviour 
of the integrated circuit device can be learnt from a set of 
random test patterns using a neural network. 

25 

This mode of operation of the neural network can be referred 
to as leanring mode. 

After the learning process has been completed, the ATE is 
30 able to perform test pattern classification. The ATE may 

thus select sub-optimal patterns for subsequent simulation or 
testing of the integrated circuit. The selected test 
patterns sufficiently approximate worst case scenarios. 

35 Accordingly, the invention also provides for a method of 
selecting test patterns, the method comprising: 
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(m) applying a test pattern to a neural network whose 
parameters have been adapted to approximate the behaviour of 
an integrated circuit according to the above described 
method; 

5 (n) processing the output of the neural network to determine 
whether predetermined criteria are met; and 
(o) selecting for storage the test pattern if the 
predetermined criteria are met. . 

10 Using this method, a sufficient number of test patterns are 
provided for an efficient simulation or testing of the 
integrated circuit. 

This mode of operation of the neural network can be referred 
15 to as operation mode. 

Accordingly, there is also provided a method of testing an 
integrated circuit; the method comprising: applying test 
patterns that have been selected according to the above 
20 described method of selecting test patterns to the integrated 
circuit using automatic test equipment (ATE) . 

In addition, there is provided a method of simulating an 
integrated circuit; the method comprising: applying test 
25 patterns that have been selected according to the above 

described method of selecting test patterns to a simulator 
for simulating an integrated circuit. 

According to a preferred embodiment of the invention, the 
30 test patterns that have been selected in accordance with the 
above described neural network-based approach are further 
optimized using a genetic algorithm. 

Thus, there is provided a method of providing a test pattern 
35 for the simulation and/or test of the layout of an integrated 
circuit, the method comprising the steps of: 
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(A) providing a set of test patterns consisting of test 
patterns selected in accordance with the above described 
method of selecting test patterns; 

(B) applying the set of test patterns to the integrated 
5 circuit using automatic test equipment (ATE) ; 

(C) determining the outputs of the integrated circuit; 

(D) processing the outputs to determine whether 
predetermined test criteria are met-; 

(E) depending on the determination in step (D) , generating a 
10 new set of test patterns on the basis of the set of test 

patterns provided by step (A) using a genetic algorithm* 

This combination of neural network- and genetic algorithm- 
based approaches further increases the chances of finding 
15 test patterns that sufficiently approximate worst case 
scenarios of operation of the integrated circuit. 

The method employs a genetic algorithm (optimization method) 
to optimize a set of pre-selected patterns based on 
20 measurements using an ATE. Thereby, a set of worst case 

noise patterns can be selected automatically. By using ATE 
for the processing of the test patterns, performance is 
greatly enhanced compared to approaches based on simulation. 

25 Test patterns generated accordingly can additionally be re- 
simulated for further detail design analysis and improvement. 

The genetic algorithm approach can be implemented using 
existing ATEs . 

30 

The invention will now be described, by way of example only, 
with reference to the accompanying drawings, of which: 

Figure 1 illustrates schematically a classification of three 
35 groups of test patterns; 
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Figure 2 illustrates a process representing the neural 
network learning mode according to an embodiment of the 
invention; 

5 Figure 3 illustrates a process representing the neural 
network operation mode according to an embodiment of the 
invention; 

# a o n 

Figure 4 illustrates a schematic flow diagram of a genetic 
10 algorithm using intital random pattern generation; and 

Figure 5 illustrates a schematic flow diagramm of a method 
combining neural network-based pre-selection of test patterns 
and subsequent optimization using a genetic algorithm* 

15 

In accordance with one embodiment of the invention, a neural 
network model is implemented into the ATE * That is, the ATE 
is able to learn automatically from test runs of an 
integrated circuit performed on the ATE. After training of 

20 the neural network has been completed, it is able to identify 
which group of test patterns belong to a sub-optimal set. 
For this purpose, some million test patterns are selected via 
the neural network. Subsequently, the pre-selected sub- 
optimal pattern is simulated (simulation approach) or 

25 measured (ATE approach) to further determine which of the 
patterns fulfill predetermined criteria. Those patterns 
which fulfill the criteria are selected for storage. 

Figure 1 illustrates schematically a classification of three 
30 groups of patterns. Since the simulation approach- or ATE 
approach-based selection of patterns is performed on the 
basis of a sub-optimal set of patterns (group C) , the speed 
and efficiency compared to conventional methods for 
identifying suitable test patterns is considerably improved. 
35 This approach is referred to as maximum approximation. 
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Suppose, as illustrated in Figure 1, there are P N e{P N A P N B 
Pn c }/ N > 0, three groups of test patterns within a full 
range of all possible test patterns. Instead of searching 
through all possible patterns, the neural network may learn 
5 and distinguish between different groups of test patterns 
using an ATE-based training program. Accordingly, the test 
patterns are pre-classif ied. 

n c 

In the maximum approximation algorithm mode, the sub-optimal 
10 set P N C and P N B r\ P N C are generated based on neural network 

decisions, and a sub-optimal pattern set forms a new pattern 
population . 

This process can be repeated iteratively on the basis of the 
15 new pattern population, thereby to select the best group of 
patterns out of the sub-optimal population, and so on. 

A neural network is an interconnected assembly of simple 
processing elements, units or nodes, whose functionality is 
20 loosely based on that of the animal neuron. The network 

ability of the network is stored in the inter-unit connection 
strenghts, or weights, obtained by a process of adaptation 
to, or learning from, a set of training patterns. 

25 Figure 2 illustrates a process representing the neural 
network learning mode according to an embodiment of the 
invention. The neural network is based on back-propagation 
net characteristics to perform a pattern classification task. 
In the beginning, the neural network learns from a set of 

30 random patterns. The test results are supervised by a test 
system (ATE) . The learning, process is terminated when the 
learning error is less than a predetermined value. 
Subsequently, a neural network learning weight ("brain") file 
is generated. This file is then used in operation mode to 

35 perform a pattern classification task. 
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Figure 3 illustrates a process representing the neural 
network operation mode according to an embodiment of the 
invention. In the operation mode, the neural network is able 
to perform pattern classification based on previous learning 
5 experience (contained in the NN brain file) for pattern 
approximation and selection. The procedure of pattern 
selection may be based on a very small set of NN pattern 
populations. For example, one NN ^pattern population may 
include six NN decision patterns. The neural network first 

10 determines whether any pattern out of these six NN decision 
patterns belong to a potential maximum current group (sub- 
optimal group) . If yes, then this pattern is selected* If 
no, then the search is repeated using the same procedure. In 
the final network classification, only those patterns are 

15 selected which cause a higher dynamic current than patterns 
that have been tested in real measurements (RSMA) . For 
example, using this approach, 6*100 = 600 patterns can be 
classified, of which only 100 patterns require testing 
through measurement to determine if they cause higher dynamic 

20 currents, while the other 500 patterns are classified by the 
neural network. 

An implementation of the neural network pattern learning 
process and the neural network pattern classification process 
25 is given in Annex 1 and Annex 2, respectively. 

In one embodiment of the invention, the neural network is a 
back-propagation neural network. Back-propagation is a 
supervised learning algorithm mainly used by multi-layer- 
30 perceptrons in order to change the weights associated with 
the net's hidden neuron layer (s) . 

Another embodiment of the invention will now be described by 
reference to Figures 4 and 5. In this embodiment, test 
35 patterns selected by the neural network are further optimized 
using a genetic algorithm. 
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For the purposes of illustration, Figure 4 shows a schematic 
flow diagram of a genetic algorithm without pre-selection of 
test patterns by a neural network (instead, the initial 
patterns are generated on a random basis) . 

5 

Figure 5 illustrates a schematic flow diagramm of a method 
combining neural network-based pre-selection of test patterns 
and subsequent optimization using a gejietic algorithm, ,in 
accordance with an embodiment of the invention. 

10 

Genetic algorithms are based on the principles of natural 
selection. In particular, genetic algorithms are stochastic 
search methods which simulate natural biological evolution. 
The algorithms operate on the basis of a population of 
15 potential solutions and, applying the principle of "survival 
of the fittest" to these potential solutions, produce a 
better approximation of a target solution in each iteration 
of the algorithm. 

20 Each iteration of the algorithm produces a new generation of 
approximations. The approximations of each generations are 
created by the process of selecting individuals according to 
their level of "fitness" in the problem domain ♦ The selected 
individuals are bred with one another using operators 

25 borrowed from natural genetics. This process leads to the 
evolution of populations of individuals that are better 
suited for their environment than the individuals from which 
they were created, just as in natural adaptation. 

30 Accordingly, genetic algorithms model natural processes such 
as selection, cross over, recombination and mutation. 

Figure 4 shows a method for detecting the worst case current 
consumption/peak current pattern (RSMA) based on a genetic 
35 algorithm. This method operates on the basis of populations 
of individual patterns instead of a single pattern solution. 
In this way, the search for better approximations can be 
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performed in a parallel manner. Therefore, this method is 
more efficient than single pattern searching processes using 
dynamic random algorithm methods. 

5 Genetic algorithms may be employed for the simulation of an 
integrated circuit design in order to solve the worst case 
pattern search problem. The efficiency of genetic searching 
procedures js largely dependent on the number 5 of pattern 
populations and the number of test patterns in each pattern 

10 population. However, as indicated above, the simulation- 
based approach forms a limitation if genetic algorithms are 
to be employed. The genetic selection procedure has to 
evaluate every "fitness" (dynamic peak/averaged current) of 
the test patterns in each pattern population. For example, 

15 there may be 200 pattern populations each including 20 

patterns. Thus, the genetic algorithm has to evaluate the 
fitness of 200 * 20 = 4000 patterns. If each test pattern is 
a 50 cycles test pattern which requires 30 minutes of 
simulation time (e.g. EPIC oder SPICE simulator), then the 

20 total required searching and simulation time is 4000 * 30 

minutes = 120000 minutes, i.e. approximately 83 days of non 
stop simulation in order to process 200 pattern populations 
only. 

25 In addition, the full pattern combination domain increases 
proportionally to the complexity of VLSI or ULSI designs. 
Therefore, a subset of 200 pattern populations is only a very 
small subset of the full pattern combination domain. 

30 In contrast, when using a genetic algorithm together with 
ATE, many more pattern populations per time unit can be 
processed. This is because the testing of an integrated 
circuit using ATE is considerably faster than simulation 
using conventional systems. Accordingly, the approximation 

35 of worst case test patterns in a given period of time is much 
more accurate. 
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An implementation of a dynamic genetic algorithm for use with 
ATE is presented in the following. At the beginning of the 
computation, a number of individual random patterns 

Pn P0P = (Pi/ P2/ •-•/ Pn) 

are randomly generated and initialized, wherein N is the 
maximum number of random patterns, and POP is the laaximum 
number of pattern populations. 

Subsequently, for each individual pattern (p x , P2/..*, Pn) / 
the objective functions 

Ipeak(V Isample(PN/ SRMS ) ) 

and 

laveraged (Pn^ SRMS ) 

2 0 are evaluated using equation (1) : 

R *ff L *S 

T = SRMS(T mm , r max ) => Random _ Float _ Number (T^ , T mx ) 

^max — ^Inin ' ^^min >^max > ^> I Measurement i^N » T) ^ {/ peak J averaged} 



15 



25 



30 



The first (initial) generation is thus produced, and the 
averaged fixness of the individual patterns (pi, p 2 , . . . , p N ) 
is calculated using equation (2) : 



if 

^ ' ^ Measurement ) 

Averaged _Fixness(Fixness{PZ op y) = 22 - , N,P N >0 

Fixness{P N ) = I Measuranen , (P N , T) e {/ peak I avemged } 



35 



If the optimization criteria 
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(Averaged Fixness (I Measurement (Pn POP ) ) < Imax rep) 

is not met for any existing population, a new population is 
created on the basis of the existing population. Individual 
5 patterns are selected according to their fitness for the 
production of offspring (loopl in Figure 4) . 

In this selection approach, the basic concept of tournament 
selection is employed. That is, only the best individual 
10 pattern from the existing population is selected as a parent. 
This process is repeated until a pre-defined percentage of 
best patterns has been selected: 

(3) 

15 SortingiJ^^^iP^s^iP^) /„„ )}) => Parent (I Measurmatl (P„ )) 



wherein B is the pre-defined percentage of the best pattern 
20 group. The sorting function first re-arranges the test 

patterns from minimum to maximum according to their fixness 
values. Subsequently, the parent selection is generated in 
random sequence based on the new sub-optimal fixness range N, 
which is calculated using B. Parents (selected patterns) are 
25 combined using cross over (4) , re-combined (5) and mutated 
(6) in order to produce offspring: 

CrossOver(P N (C, , C 2 ), P N+} (C 3 , C 4 )) => Upper _ CrossOver{P N (C 3 , C 2 ), (C, , C 4 )) 

=> Lower _ CrossOver{P N (C, , C 4 ), P N ^ (C 39 C 2 )) , ) 
=> Stripe _ CrossOver(P N (C 4 , C 3 ), P„ +1 (C 2 , C x )) 



30 



where C is the test pattern content which is selected for 
cross over of two patterns. In the cross over process, 
35 upper, lower or stripe cross over methods are performed in 

random sequence, and the contents of two cross over patterns 
are exchanged in order to produce two new offspring patterns 
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Thereafter, the re-combination equation (5) is used to select 
the best fixness pattern out of two new cross over offspring 
patterns : 



5 Re combination^ 9 P N +>) ^ I nwimum {P Ni P Nn ) => I Bes9 {P M ), N,M,P N >0 (&) 
Mutation{P M (C, , C 2 , C 3 , C 4 . C y )) />„ (C, +R l9 C 2 +R 2 ,...,..C, + ) . . 



10 where M is the number of new selected offspring patterns to 
form the new population. After recombination, the offspring 
undergoes mutation. Offspring variables are mutated by the 
addition of small random values 



The mutation process helps to improve the optimization search 
process . 

20 Finally, all offspring patterns are inserted into the 
population, replacing the parents (original pattern 
population) and producing a new generation. This cycle (loop 

1 in Figure 4) is performed until the optimiziation criteria 
are met. 

25 

If the fitness does not improve after a pre-defined number of 
genetic breeding generations, a new pattern population (loop 

2 in Figure 4) will be generated in random sequence. This 
combination greatly increases the chances of finding worst 

30 case test patterns* 

A complete implementation of this algorithm using ATE J973 is 
given in Annex 3 . 





15 



Ry e {1 0 -1}. 



35 



Figure 5 illustrates a flow diagramm of a method combining 
neural network-based pre-selection of test patterns and 
subsequent optimization using a genetic algorithm. 
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A complete implementation of this combined approch using ATE 
J973 is given in Annex 4. 

5 It is to be noted that the invention is not restricted to the 
embodiments and implementations described herein but 
encompasses modifications and variations within the scope of 
the invention as determined from the claims. 
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Annex 1: Neural Network Pattern Learning Implementation 
Using ATE J973 

Start Neural Network Training Using ATE: Circuit Initialization 

Default AC/DC Specification Initialization. j 
DP Dummy Pattern : Vector Memory Initialization ^ 

INPUT: {M Vector _ cycle DP Auto Range s G Epqch Max _ Loop EX File_Name 

Check if Input valid? \ 
else Input Error! exit( 1 ) . \ 

For PI * 0, 1, 2, 3, , Autojlange+l do : (Automatic Input & Output Range Calculation) ! 

{ " < 

Random _ Pattern _ Generation => P e {p x , p 2 p N ) : Random Pattern Population 

V f vector _ cyc/e, JV > 0 

V > ^ peak I averaged CjV )) G {^1 ^2 }> ^ojfiei = (^ma* ~" ^min ) X ^offset » ^offset** > 0 

e {^min = ^nun + -^ojpef } ' 
^2 € {^ W jrfll ~ ^min ~" 1 X midn = ^min + X Q ff set } ! 
^3 € {^«M2l = ^m«*l2 ~ 1 X mid22 = X mid2l + X ^4 } 

Jf 4 e {Jf^ = X mid22 — l} 

> 

Neural Network Training Loop: 

{ 

Random Pattern Generation =>Pg {pi,P 2 y —~>Pn) : Random Pattern Population 

\f vector _ cyc/e, > 0 



Vector _ Code _ Matrix(P N (Vector _ Cycles)) 



P 0 (Vector _ Cycles) 
P t (Vector ^Cycles) 



P N (Vector _ Cycles) _ 

P v (Fee/or _ Cycles) <e P„ (vector _ encode(\f signal _ 6115), Vector _ Cycles)) (ATE Training Set) 

Pattern _ Generator (Vector _ Memory (P# )) 

Pattern _Controller(Vector _Memory(P N )) N > 0 (Pattern Executor) 

Start Pattern Generator: P w (7V, , T max ) => Dynamic _ Pattern 

Start Current Measurement & Calculation: 
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T)- VoDi f KtT) + t~ t v oD(P N ,T)dr + at cuos (p n ,T), vt,p„ > 0 

T = SRMSiT^ ,r max )=> Random _ Float _ Number (T^ , T msx ) 

Stop Pattern Generator: P„ : (V/^,, (P„ , SRMS)) , (P w , SRMS) 

% = J Measurement (^JV » ^) G {^p*iJfc ? averaged } 

» *i <« 

* 2 * **} (Neural Network Learning Set) 



1 



1 + e 



-JTxO 



£T = - J] Z (*7 ~ z * ) 2 (Supervising learning via ATE) 

9E JliYt-Z^xYfil-Y^xX! 



w ji = w /i~ € x (~ — ) xG 



ag 



2?(fV )+ == E(P N ) (pattern population Learning Error calculation) 
Training Loop + + 

if (Tranining _Loop > Epoch ) (pattern population learning done) 
Epoch 

if (Tranining __ Loop > Max Loop ) 
{ So Far Neural Network Learning File (Filejfame) Generation, exit(l) } 

if(E>EX) 

{ Go To Neural Network Training Loop : Learn Again!! Initialize: £ = 0 } 
else 

{ Expected Neural Network Learning File (File_Name) Generation, exit(l) } 
} End Of Neural Network Learning 
Final Neural Network Learning Plot Generation (Figure 27). 
End Of Neural Network Learning via ATE 
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Annex 2: Neural Network Pattern Classification 
Implementation Using ATE J973 

Start NN_MA: Circuit Initialization 

Default AC/DC Specification Initialization. 

DP Dummy Pattern : Vector Memory Initialization 

INPUT: {N Vector _ cycle DP Max _ Loop File ^ Name] 

Check if Input valid? 
else Input Error! exit(l). 

NN _ Learning _ File(File _ Name) e {w» f G I*} 

NN_MA_Loop: 
{ 

Random _ Pattern _ Generation =>Pg(p„p 2 , ^J: Random Pattern Population 

V vector cyc/e, N >0 

X k {P N J Measur ^ eni {P N ))A x " x ' Jf*} (Neural Network Evaluation Set) 



1 + e 



*/Y v ^ (X) < ^^^/^ ) 

{ Go to NN_MA_Loop : New Pattern Population Generation !!! > 

else 

{ Sorting(P N , y„ (X)) => P M (sub-optimal set based on neural netw rk) } 

~ P 0 (Vector _ Cycles) ~ 

P (Vector Cycles) 
Vector _Code_Matrix(P M (Vector _Cycles))=> 1 r 

P M (Vector _ Cycles) 
P M (Vector _ Cycles) e P M (vector _ encode(V signal _ 6ws), Vector _ Cycles)) 
Pattern _ Generator(Vector _ Memory(P M )) 

==> Pattern Controller (Vector Memory (P M )) M > 0 (Pattern Executor) 
Start Pattern Generator: P„ (r min , T max ) =r> Dynamic __ Pattern 
Start Current Measurement & Calculation: 
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^^(^>n- Fpo f M,r) + -~-l~V DD (P M ,T)dT 4- AI cuos (P u ,T), VT,P U >0 
T = S^MS^,^) => Random _Float_Number(T mia ,r maK ) 

^niax — ^min » ^^min > ^max > ^ 

* ■ • 

Stop Pattern Generator: P u : 1^ ( V/^ {P M , SRMS)) , I nerogfd {P u ,SRMS) 

^ Measurement I averaged } 

NN _Max _Loop + + (operating loop counter) 

Sorting(P M J Measurement {P M )) => ^ e iec^ (best out of sub-optimal set via ATE) 

if ( I Measurement {f* selected ) ^ ^ ^ Measurement ( ^previous _ selected ) ) 

{ Update VCM Database File} 

if(NN_Max_Loop < Max _ Loop) 

{ Go to lWJMAJLoop : New Pattern Population Generation !!! } 
else 

{ Final VCM Database File Generation exit(l) } 

} 

Final Neural Network Maximum Approximation Plot Generation (Figure 29). 
End OfNNJMLA 
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Annex 3: Dynamic Genetic Algorithm Implementation Using ATE 
J973 

Start D_GA: Circuit Initialization 

Default AC/DC Specification Initialization. 

DP Dummy Pattern : Vector Memory Initialization 

INPUT: {N Vector ^Cycles DP Loopl Loop! I Max REF ] 

Check if Input valid? 
else Input Error! exit(l). 

For P0P = 0, 1, 2, 3, , Loop2+\ do : 

{ 

Random Pattern Generation => P e (p, , p 2 p N ) 

\/ vector _ cyc/e, N > 0 

— (Pi > P2 »— -» P* ) Initial Pattern Population 

For PI =0, 1,2,3, , Af-H do : 

{ 

P 0 (Vector _ CycZes) " 



Sector CWe _ Matrix(P N {Vector _ Cycles)) 



P x (Vector ^Cycles) 

P N (Vector _ Cycfey) 
P^ (Kecfor _ Cycles) e P„ ( vector _ encode^ signal _ bus), Vector _ Cycles)) 
Pattern _ Generator(V ector _ Memory(P N )) 

==> Pattern _ Controller {y ector _ Memory(P N )) N > 0 (Pattern Executor) 

Start Pattern Generator: P N (TV, , 7^ ) => Dynamic _ Pattern 
Start Current Measurement & Calculation: 

r Mmurm ,eAP^T) = VDl > ( f N ' T) + ±-(~v DD {P N j)dT + dJ CMOS (p„,T), vt\p„ >o 

T = SRMSW^ , ) => / Wo»i F/oa* _ Number^ , 7^ ) 

Stop Pattern Generator: P„ : /^(V/^P^SKMS)), I averaged {P N ,SRMS) 

Fixness(P N ) = / Meajl<remeB/ (P N , T) e {/^ I averagal } 

} 

/ j Measurement 

Averaged _ Fixness(Fixness(P™ p )) = — , N, P N > 0 

TV 
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if (Averaged _ Fixness(I Meamremen , (P™ P )) > / Max REF ) 
{ Final VCM Generation (Database 1) exit(l) } 

For P2 = 0, 1, 2, 3, , Loopl+\ do : 

Sorting(I Mauuremtm (P N ) e {l min (P^ ) 1^ (P„_ )}) Parental MeamrmeiU (P„ )) 

^K*, N m J Nefr^-N^-iN^xB} 7V_} 

Cra*sOver(P„ (C, , C 2 ), P„^ (C 3 , C 4 )) => t//>per _ CrossOver(P N (C 3 , C 2 ), P„ +I (C, , C 4 )) 

=> Lower _ CraM0ver(P w (C, , C 4 ),P W+I (C 3 , C 2 )) 
=> ttripe _ CrossOver(P N (C 4 , C 3 ),P W+I (C 2 , C, )) 

Recombination(P N ,P W+1 ) => (P„ ,P V+1 ) => / Sc „(P M ) , N,M>P N > 0 

Mutofto«(P M (C 1 ,C 2 ,C 3 ,C 4 ....C j; ))=> P M (C, +i?„C 2 +* 2 , C y +R y ) 

R y e{\ 0 -l},M,P M ,;y>0 

For P3 = 0, 1, 2, 3 , M+l do : 

{ 

Pattern __ Generator(Vector _ Memory {P M )) 

=> Pattern _ Controller (Sector _ Metnory(P M )) M > 0 (Pattern Executor) 

Start Pattern Generator: P M (7*^ , 2^ ) => Dynamic _ Pattern 
Start Current Measurement & Calculation: 

/m—*,, (p m ,t)= Vdd i r) + J-f-T OD (p M ,Drfr + A/ CWOJ (P M ,n, vr,p w >o 

r = SRMSiT^ , r m „ ) => tfam/om _ P/oa* _ Number(T^ , ) 

Stop Pattern Generator: P M : I peak (VI sample (P M ,SRMS)), I averoged (P M ,SRMS) 

Fixness{P u ) = I Meosureme „, (P M , T) e {/ peaJl 7 averagerf } 

> 

M 

/ * Measurement 

Averaged _Fixness(Fixness(P™ p )) = ^ M,P M >0 

M 

if ( Averaged _Fixness(I Measurement (P™ p )) > I Max WF j 
f Worst Case Pattern Found : Final VCM Generation (Database 1) exit(l) } 

} End Of Loop 1 
} End of Loop 2 

Update So Far Worst Case Pattern Found : Final VCM Generation (Database 1) 
End OfDjGA 
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Annex 4: Combined Neural Network Pattern Classification and 
Dynamic Genetic Algorithm Implementation Using ATE 
J973 



Start NN_GA: Circuit Initialization 

Default AC/DC Specification Initialization. 

DP Dummy Pattern : Vector Memory Initialization 

INPUT: {N Vector _cycle DP Max Loop Loopl I Max REF File Name} 

Check if Input valid? 
else Input Error! exit(l). 

NN_Learnmg_File(File_Name)s{w y e G X k ] 
NN_GAJLoop: 

Random _ Pattern __ Generation => P e (p, , p 2 p N ) : Random Pattern Population 

V vector _cycle 9 N > 0 

X k (P N ,I Measuremenf {P N )) e {x k X k ........ X}} (Neural Network Evaluation Set) 

i 

1 + e 

l/rV^ ( X ) < Kub, optimal, set ) 

{ Go to NNJMAJLoop : New Pattern Population Generation !!! } 

else 

{ Sorting(P N ,Y N (X)) => P M (sub-optimal set based on neural network) } 
P M => P N (replacing the old population with new sub-optimal set) 

For PI = 0, 1, 2, 3, , LoopJ+\ do : (Start genetic algorithm to further improve sub-optimal set) 

S° rtin S{I Measurement i P N ) € min (^Vuin ) ^max (^„„ ) j) J* arent (I Measurement i^N )) 
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CrossOver(P N (C, , C 2 ), P„ +l (C 3 , C 4 )) => L/pper _ CrossOver(P N (C 3 , C 2 ), P w+ , (C, , C 4 )) 

=> Lower _ CrossOver(P H (C, , C 4 ), P^, (C 3 , C 2 )) 
=> Stripe _CrossOver{P N {C A ^\P N ^{C lt C x y) 

Recombindtion(P N ,P N , i )^T^ imum (P N ,P N+l )=>I Best (P M ), N,M,P N >0 

Mutation{P M {C ly C 2 ,C^C^-C y )) => P„(C, + P„C 2 +P 2 , C, + 

R y e{l 0 -lj.M.P^pO,, 

For P3 = 0, 1, 2, 3, , M+l do : 

{ 

Pattern _ Generator(Vector _ Memory(P M )) 

=> Pattern _Controller{Vector _Memory{P M y) M > 0 (Pattern Executor) 

Start Pattern Generator: i» w CT^.r^) => Dynamic Pattern 
Start Current Measurement & Calculation: 

^ Measutetnettt . D = — "fr ' ~ + 7^ f*X D (P„ , T^P + A/^P^.D, V7\P„ > 0 

J = SRMSiT^.T^) => Random _Float_Number(T miny r rm ) 

Stop Pattern Generator: P w : l peak {VT tmvh (P Mf SRMS)) m I mangai (P M ,SRMS) 

Fixness(P„ ) = / Wwurtmeirt (P M , r) 6 {/^ / oW } 

} 

x . I Measurement 

Averaged _ Fixness(Fixness(P™ p )) = ^ , M, P w > 0 

if (Averaged _Fixness{I Mmuremeni (P™ P )) > I Max ^ F ) 
{ Worst Case Pattern Found : Final VCM Generation (Database 1) exit(l) } 

} End Of Loop 1 

NN Max _ Loop + + (operating loop counter) 

if (NN _Max _Loop < Max _ Loop) 
{ Goto NN_GAJLoop : New Pattern Population Generation !!! } 

else 

{ So Far Worst Case Pattern Found : Final VCM Generation (Database I) exit(l) } 

} 

Final Neural Network + GA Plot Generation (Figure 3 i). 
End OfNN^GA 



1 
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Claims : 



1. A method of approximating the behaviour of an integrated 
5 circuit, the method comprising: 

(a) applying a set of test patterns to a system for testing 
or simulating an integrated circuit; 

(b) applying the set of te^t patterns to a rfeural network; 

(c) comparing the outputs of the system for testing or 
10 simulating the integrated circuit and the outputs of the 

neural network; and 

(d) adapting parameters of the neural network to approximate 
the behaviour of the integrated circuit on the basis of the 
comparison . 



2. The method of claim 1, wherein the system for testing or 
simulating the integrated circuit is an automatic test 
equipment (ATE) , and the set of test patterns is applied to 

2 0 the integrated circuit via the automatic test equipment. 

3. The method of claim 2, wherein the neural network is 
implemented in the automatic test equipment. 



3. The method of claim 1 or 2, wherein the set of test 
patterns is generated on a random basis. 

4. The method of any preceding claim, wherein step (d) 
comprises : 

adapting the inter-unit weights of the neural network through 
back-propagation . 



15 



25 



35 



5. The method of any preceding claim, comprising: 
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repeating steps (a) to (d) until the level of adaptation in 
step (d) falls below a predetermined value. 

5 6. The method of claim 5, comprising: 

storing data representing predetermined neural network 
parameters following termination of the repetition of steps 
. < a > to (d) . 

10 

7* A method of selecting test patterns, the method 
comprising : 

(m) applying a test pattern to a neural network whose 
parameters have been adapted to approximate the behaviour of 
15 an integrated circuit according to the method of any 
preceding claim; 

(n) processing the output of the neural network to determine 
whether predetermined criteria are met; and 
(o) selecting for storage the test pattern if the 
20 predetermined criteria are met. 

8. The method of claim 7, comprising: 

repeating steps (m) to (o) until a predetermined number of 
25 test patterns have been stored. 

9. The method of claim 7 or 8, wherein the predetermined 
criteria are met if the value of a predetermined parameter of 

3 0 a signal output by the neural network in response to the 

application of the test pattern exceeds a reference value. 

10. The method of claim 9, comprising: 

35 (p) applying a further set of test patterns to the 

integrated circuit using automatic test equipment (ATE) ; 
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(q) measuring the values of the predetermined parameter of 
output signals generated by the integrated circuit in 
response to step (p) , wherein the predetermined criteria are 
met if the value of the predetermined parameter of the signal 
output by the neural network in response to the application 
of the test pattern exceeds the reference value and all 
values measured in this step (q) . 



10 11. The method of claim 10, wherein the further set of test 
patterns is generated on a random basis. 



12. The method of any of claims 9 to 11, wherein the 
15 predetermined parameter is a dynamic current. 



13. The method of any of claims 7 to 12, further comprising: 
(r) generating a test pattern population consisting of a 

20 plurality of test patterns; 

(s) applying each test pattern of the population to the 
neural network; 

(t) for each test pattern, processing the output of the 
neural network to determine the value of a predetermined 
25 parameter; 

(u) allocating each test pattern to one of a plurality of 
classification groups in accordance with the parameter value 
determined in step (t) . 

30 

14. The method of claim 13, comprising: 
repeating steps (r) to (u) using a new test pattern 
population consisting of the test patterns included in a 
selected one of the classification groups. 



35 
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15. The method of claim 14, wherein the selected one of the 
classification groups consists of test patterns that 
approximate a set of worst case input parameters of operation 
of the integrated circuit* 

5 

16. The method of any of claims 7 to 15, comprising: 
repeating steps (m) to (o) plural times; 

applying the test patterns selected in each step (o) to a 
10 simulator for simulating the integrated circuit; 

processing the output of the simulator to determine whether 
further predetermined criteria are met; and 
selecting for storage those test patterns wich meet the 
further predetermined criteria. 

15 

17. The method of any of claims 7 to 16, comprising: 
repeating steps (m) to (o) plural times; 

applying the test patterns selected in each step (o) to the 
2 0 integrated circuit using automatic test equipment (ATE) ; 
processing the output of the automatic test equipment to 
determine whether further predetermined criteria are met; and 
selecting for storage those test patterns wich meet the 
further predetermined criteria. 

25 

18. The method of any preceding claim, wherein the 
predetermined criteria represent an approximation of a worst 
case mode of operation of the integrated circuit. 

30 

19. A method of simulating an integrated circuit; the method 
comprising : 

applying test patterns that have been selected according to 
35 the method of any of claims 10 to 18 to a simulator for 
simulating the integrated circuit. 
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20. A method of testing an integrated circuit; the method 
comprising: 

applying test patterns that have been selected according to 
5 the method of any of claims 10 to 19 to the integrated 
circuit using automatic test equipment (ATE) . 

21. A method of providing a test pattern for the simulation 
10 and/or test of the layout of an integrated circuit, the 

method comprising the steps of: 

(A) providing a set of test patterns consisting of test 
patterns selected in accordance with the method of any of 
claims 7 to 18; 

15 (B) applying the set of test patterns to the integrated 
circuit using automatic test equipment (ATE) ; 

(C) determining the outputs of the integrated circuit; 

(D) processing the outputs to determine whether 
predetermined test criteria are met; 

20 (E) depending on the determination in step (D) , generating a 
new set of test patterns on the basis of the set of test 
patterns provided by step (A) using a genetic algorithm. 

25 22. The method of claim 21, comprising: 

(Fl) repeating steps (B) to (E) until the predetermined test 
criteria are met* 

30 23. The method of claim 21, comprising: 

(F2) repeating steps (B) to (E) for a predetermined number of 
times or until the predetermined test criteria are met. 

35 24. The method of any of claims 21 to 23, wherein the 
predetermined test criteria are met if the set of test 
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patterns is associated with an average fitness above a 
predetermined value. 

5 25. The method of any of claims 21 to 24, wherein step (E) 
comprises : 

combining some or all of the test patterns according to the 
genetic algortihm to provide the new set of test pattern^. 

10 

26. The method of claim 25, further comprising: 
selecting test patterns out of the set of test patterns 
according to predetermined selection criteria; and 
combining the selected test patterns according to the genetic 

15 algortihm to provide the new set of test patterns 

27. The method of claim 26, comprising: 

selecting a test pattern if it is associated with a fitness 
20 value greater than a reference value. 

28. The method of claim 26 or 27, comprising: 

(G) selecting a test pattern if it is associated with the 
25 highest fitness value of all unselected test patterns. 

29. The method of claim 28, comprising: 

repeating step (G) until a predetermined percentage of test 
30 patterns has been selected. 

30. The method of claim 28, wherein step (E) comprises: 

(H) arranging the selected test patterns in the order of 
35 associated fitness values; 

(I) randomly selecting parent test patterns out of the test 
patterns as arranged in step (H) ; and 
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(J) combining the selected parent test patterns. 

31. The method of any of claims 21 to 30, wherein the 

5 genetic algorithm includes crossing over, re-combination, 
and/or mutation of selected test patterns, 

32. The method of any of claims 21 to 31, wherein step (A) 
10 comprises: 

providing a plurality of sets of test patterns, wherein each 
set of test patterns is included in a test pattern 
population* 

15 

33. The method of claim 32, comprising: 

performing the steps of any of claims 21 to 32 for each 
population. 

20 

34. Data processing system, adapted to perform the method of 
any preceding claim. 

25 35. Computer program, for performing the method of any of 
claims 1 to 33 on a data processing system. 



200207799 & 200207778 / IT465 



3X EO °-B£«UN 
Abstract ^ "^7- 

Method of processing test patterns for an integrated circuit 

There is provided a method of approximating the behaviour of 
an integrated circuit, the method comprising: (a) applying a 
set of test patterns to a system for testing or simulating an 
integrated ^circuit; (b) appLying the set of test patterns to 
a neural network; (c) comparing the outputs of the system for 
testing or simulating the integrated circuit and the outputs 
of the neural network; and (d) adapting parameters of the 
neural network to approximate the behaviour of the integrated 
circuit on the basis of the comparison. In particular, the 
system for testing or simulating the integrated circuit may 
be an automatic test equipment (ATE) , and the set of test 
patterns is applied to the integrated circuit via the 
automatic test equipment. The invention is based on the idea 
that the dynamic behaviour of the integrated circuit device 
can be learnt from a set of random test patterns using a 
neural network. After the learning process has been 
completed, the ATE is able to perform test pattern 
classification. The ATE may thus select test patterns for 
subsequent simulation or testing of the integrated circuit. 
Preferably, the selected patterns are further optimized using 
a genetic algorithm. 
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